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(54) Apparatus and method for data transmission 



(57) A data transmission apparatus for transmitting 
data comprising a plurality of objects having respective 
priority, comprises an error-correction coding section 
(31) for selecting an error-correction coding method for 
each of the plurality of objects based on the priority of 
each of the plurality of objects and error-correction cod- 
ing of each of the plurality of objects using the selected 



error-correction coding method. Therefore, it is possible 
to effectively use the resources, maintain the real-time 
transmission of data, and prevent degradation of trans- 
mitted data by changing the level of the error-correction 
according to the priority of object, and performing the 
error-correction coding for the objects according to the 
priority. 



CM 
< 

CD 
CO 



Q. 
LU 



ORIGINAL DATA 

A 



SCENE 

DESCRIPTION 



ES 



ES 



SCENE SYNTHESIZING SECTION —7 



ES 



6-H 
-1 



SCENE 
DESCRIPTION 



MULTIPLEXING 
SECTION 30 



ERROR-CORRECTION CODING SECTION 



PACKET MULTIPLEXING SECTION 



DATA TRANSMISSION SECTION 



-32 



-33 



ES 



ES 



ES 
T 



ERROR-CORRECTION DECODING SECTION 



DEMULTIPLEXING 
SECTION 40 



-41 



PACKET DEMULTIPLEXING SECTION 



T-42 



DATA RECEPTION SECTION 



-43 



DATA TRANSMISSION CHANNEL) 



FIG.2 



Printed by Jouve, 75001 PARIS (FR) 



BNSDOCID: <EP 1 1 1 361 4A2 J_> 




EP1 113 614 A2 



Description 

[0001] The present invention relates to an apparatus and a method for data transmission to efficiently transmit mul- 
timedia data comprised of a plurality of objects in real time through an information transmission channel in which data 
5 errors may occur. 

[0002] The MPEG-4 method (a method by a standardization group for motion picture compression of ISO/IEC), which 
is one of international standards for compression of motion picture coding method supports "object coding" to transmit 
a plurality of objects (visual and audio objects, and the like) after multiplexing. For example, a transmission side trans- 
mits one object of moving picture only for persons, and one object only for a background. Then, the receiving side 
10 decodes and synthesizes them to display them for reproduction of an image with a person or persons in a background 
image. 

[0003] FIG. 1 shows the above flow. The object coding will be described with reference to FIG. 1 . Object coding 
sections 1 are installed for each object. Original data is supplied to the object coding sections 1 and a scene description 
coding section 2. The object coding section 1 compresses and codes an object such as a moving picture and an audio, 

is to output it as a data stream. The scene description coding section 2 codes a scene description. The scene description 
is information for reproduction of the objects which are compressed and coded at the object coding sections 1 as one 
scene. The outputs of the object coding sections 1 and the scene description coding section 2 are multiplexed at a 
multiplexing section 3. The multiplexed data is transmitted to the receiving side through a data transmission channel 8. 
[0004] At the receiving side, the multiplexed data is demultiplexed to coded data of objects and scene description 

20 by a data demultiplexing section 4. The coded object data and the scene description are separately processed. Object 
decoding sections 5 decode the coded object data. A scene description decoding section 6 decodes the coded scene 
description. A scene synthesizing section 7 synthesizes the object data from the object decoding sections 5 for repro- 
duction, based on the scene description from the scene description decoding section 6. 

[0005] In a conventional device having the above configuration, the object coding section 1 compresses and codes 
25 object data such as moving picture and audio. Each coded object data is made into stream, which is called as an 
elementary stream. 

[0006] The scene description coding section 2 codes a scene description for reproduction as one scene by synthe- 
sizing the objects. The data multiplexing section 3 multiplexes data from the object coding sections 1 and the scene 
description coding section 2 to transmit them through the data transmission channel 8 as one stream. The data received 
30 through the data transmission channel 8 is supplied to the data demultiplexing section 4, which demultiplexes the 
multiplexed data into the coded data of objects and scene description. The coded data of objects are supplied to the 
object decoding sections 5, and the scene description to the scene decoding section 6. 

[0007] The object decoding section 5 decodes the coded object data to supply the object data to the scene synthe- 
sizing section 7, and the scene description decoding section 6 decodes the coded scene description to supply the 

35 scene description to the scene synthesizing section 7. 

[0008] The scene synthesizing section 7 synthesizes scenes for reproduction of images, based on the object data 
from the object decoding sections 5 and the scene description from the scene description decoding section 6. The 
scene description denotes priority of the elementary stream corresponding to each of individual objects. 
[0009] The priority is given to the objects according to production intention of an author who produces a multimedia 

40 content. For example, the priority is given to an object which the author looks upon as an important one, or to object 
with greater importance, as an object of persons generally has greater importance than those of backgrounds. 
[001 0] On the other hand, in wireless communication, there have been some cases where a mechanism to guarantee 
completeness of the data is introduced in the lower layers of a communication protocol such as a physical layer and 
a data-link layer by using a method through which detection of error at the receiving side causes request for re-trans- 

45 mission from the receiving side to the transmission side and the transmission side retransmits the data responding to 
the request when a transmission channel with high possibility of data errors such as wireless communication is used. 
[001 1 ] However, the above method may not be applied to communications which require real-time transmission such 
as MPEG-4 of so-called stream data as one of important factors, since there is a serious problem such as a time lag 
required for the re-transmission. 

so [001 2] There are increased possibility to cause pauses in reproduction of moving picture and audio at the receiving 
side due to time lags for the re-transmission, though it is important to maintain real-time transmission in the transmission 
of the stream data. The pauses in the moving picture and audio become degradations in application qualities them- 
selves. 

[0013] Thereby, in general real-time communication of multimedia data, it has been usual not to perform re-trans- 
55 mission of data at the physical layer and the data-link layer even with possible loss of the completeness of the data, 
except when there are remarkably many errors in the transmission channel. Therefore, there may be a case where a 
part of data are not transmitted. 

[0014] On the other hand, there has been a method to protect information by forward error-correction (FEC) where 
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transmission is performed by adding redundant information to original information, considering possible errors in the 
upper layers. For example, the method is found in a "H.233" standard, as a typical protocol for multiplexing and de- 
multiplexing in videophone application. In "Annex A°, "Annex B", and "Annex C* ", and "Annex D n of the "H .233" standard, 
information is defined to be protected based on the FEC. 

5 [0015] However, as there is no consideration of contents of data to be transmitted for "protection of information" in 
the above standard, the same error-correction information is uniformly added to all data without consideration of the 
importance of each data. Then, data with greater importance, and those with less importance have the same error 
rate. But, as the real-time transmission is a important factor, and objects have their own importance, in the MPEG-4, 
it is useless to perform the error-correction coding with the same level of error-correction for every object, and there 

10 may be a case to lose the real-time transmission. Therefore, the resources are not effectively used. 

[001 6] Accordingly, it is an object of the present invention to provide an apparatus and a method for data transmission, 
in which it is possible to effectively use the resources, maintain the real-time transmission of data, and prevent degra- 
dation of transmitted data by changing the level of the error-correction according to the importance of object, and 
performing the error-correction coding for the objects according to the importance. 

15 [0017] According to the present invention, there is provided a data transmission apparatus for transmitting data 
comprising a plurality of objects having respective priority, the apparatus comprising means for selecting an error- 
correction coding method for each of the plurality of objects based on the priority of each of the plurality of objects, 
means for error-correction coding of each of the plurality of objects using the selected error-correction coding method, 
and means for multiplexing plurality of coded object data and transmitting multiplexed data through a transmission 

20 channel. 

[001 8] According to the present invention, it may be possible to further comprises means for detecting a traffic quality 
of the transmission channel, and said selecting means may select an error-correction coding method based on the 
priority of each object and the traffic quality. 

[0019] According to the present invention, there is provided a data reception apparatus for receiving coded trans- 
25 mission data comprising a plurality of coded object data, each object having a priority, the apparatus comprising means 
for receiving and demultiplexing the coded transmission data into the plurality of coded object data, means for detecting 
the priority of each object, and means for error-correction decoding of each of the coded object data based on the 
priority detected by said detecting means. 

[0020] According to the present invention, there is provided an object coding apparatus for transmitting data formed 
30 of a plurality of object data and scene description data, each object having a priority, the scene description data indi- 
cating the priority of each object and how the object data are synthesized, the apparatus comprising means for deter- 
mining error-correction coding methods for the plurality of object data respectively based on the priority, means for 
error-correction coding of each of the plurality of object data using the determined error-correction coding methods, 
means for error-correction coding of the scene description data using a predetermined error-correction coding method, 
35 and means for multiplexing coded scene description data and a plurality of coded object data and transmitting multi- 
plexed data. 

[0021] According to the present invention, there is provided an object coding/decoding system comprising means 
for determining error-correction coding methods for the plurality of object data respectively based on the priority, means 
for error-correction coding of each of the plurality of object data using the determined error-correction coding methods, 

40 means for error-correction coding of the scene description data using a predetermined error-correction coding method, 
means for multiplexing coded scene description data and a plurality of coded object data and transmitting multiplexed 
data, means for receiving and demultiplexing the multiplexed data from said object coding apparatus into the coded 
scene description data and the plurality of coded object data, means for detecting the priority of each object from the 
coded scene description data, means for error-correction decoding of each of the plurality of coded object data using 

45 a decoding method based on the priority detected by said detecting means, means for error-correction decoding of 
the coded scene description data using a predetermined decoding method, and means for synthesizing plurality of 
decoded object data based on a decoded scene description. 

[0022] According to the present invention, it is possible to effectively use the resources, maintain the real-time trans- 
mission of data, and prevent degradation of transmitted data by changing the level of the error-correction according 
so to the importance of object, and performing the error-correction coding for the objects according to the importance. 
[0023] This summary of the invention does not necessarily describe all necessary features so that then invention 
may also be a sub-combination of these described features. 

[0024] This invention can be more fully understood from the following detailed description when taken in conjunction 
with the accompanying drawings, in which: 

55 

FIG. 1 shows a block diagram of a conventional data transmission apparatus; 

FIG. 2 shows a block diagram of a configuration example of a first embodiment of a data transmission apparatus 
according to the present invention; 



3 

BNSDOCID: <EP 1113614A2J_> 



EP1 113 614 A2 

FIG. 3 shows a view for explaining an FEC method according to plural-time transmission method as one embod- 
iment of the error-correction coding methods; 

FIG. 4 shows a view of a packet configuration for a packet multiplexing section of the first embodiment; and 
FIG. 5 shows a block diagram of a configuration example of a principal part of a second embodiment of a data 
5 transmission apparatus of the present invention. 

[0025] A preferred embodiment of a data transmission apparatus according to the present invention will now be 
described with reference to the accompanying drawings. 

[0026] Firstly, a basic principle of the present invention will be described. In the present invention, data with relatively 
10 greater importance is protected in data transmission on a transmission channel with possible errors by performing 
error-correction according to a priority of the data, referring to a stream priority included in the MPEG-4 objects not 
only in the MPEG-4 system, but also in a data multiplexing and transmission section. 

[00271 The present invention relates to a transmission system which multiplexes a plurality of objects (visual objects, 
audio object and the like), and transmits multiplexed data through a transmission channel. In the system, the priority 

15 denoting the priority on importance is previously given to each object and real-time transmission is required, for ex- 
ample, data transmission according to the MPEG-4. The priority, which the MPEG-4 has, for each object, is utilized 
such that an error-correction coding method is selected according to the priority of each object, and error-correction 
coding is performed according to the selected error-correction coding method. Therefore, an increase of data amount 
is prevented while protecting data with relatively greater importance. Thereby, it is possible to maintain real-time trans- 

20 mission of objects so that there is no pause in moving picture data and audio data at the receiving side and to prevent 
the degradation of data at reproduction. 

[0028] The priority given to each object in the MPEG-4 is used within reproduction process of MPEG-4, and assumed 
to be applied to the cases shown as follows: 

25 (i) reproduction of objects with less priority is temporarily stopped, or reproduction quality of objects with less 

priority is degraded, when there is an insufficiency in reproduction ability of the MPEG-4 decoder at the receiving 
side; 

(ii) transmission of objects with less priority is temporarily stopped in the MPEG-4 system at the transmission side, 
when there is an insufficiency in reproduction ability of the MPEG-4 decoder at the receiving side. 

30 

[0029] However, in an actual transmitting and receiving system to transmit data of MPEG-4, the data multiplexing 
section, and the data transmission section in the transmitting system (in many cases, the two sections are realized as 
one operational block. They are called as "data multiplexing/transmission section (Trans Mux)") is assumed to basically 
use standard methods (MPEG-2 TS, H.223, RTP, and the like.). Transmission control considering the priority of objects 

35 like the present invention is actually beyond the limits of the standard. 

[0030] Therefore, the above priority has not been considered to be used at the data multiplexing section and data 
transmission section at all. In the present invention, the above priority is used at the data multiplexing section and 
transmission section to control increase of the data amount by selecting an error-correction coding method according 
to the priority of each object, and by performing the error-correction coding according to the selected error-correction 

40 coding method. Thereby, it is possible to eliminate pauses in reproduction in moving picture and audio at the receiving 
side, and control the degradation of data in reproduction of contents, while the real-time transmission of objects is 
maintained. First Embodiment 

[0031 ] FIG. 2 shows an example (block diagram) of overall system of the first embodiment. The parts sim ilar to those 
previously shown in FIG. 1 are denoted by the same reference numbers, and detailed description will be eliminated. 

45 [0032] A data multiplexing section 30 multiplexes coded data from the object coding sections 1 and the scene de- 
scription coding section 2, and the multiplexed data is transmitted to the receiving side through the data transmission 
channel 8. The data multiplexing section 30 comprises an error-correction coding section 31, a packet multiplexing 
section 32, and a data transmission section 33. The error-correction coding section 31 selects an error-correction 
method, based on priority information of the coded data, and has a function to perform error-correction coding the code 

so data, using the selected error-correction method. 

[0033] The error-correction coding section 31 receives the coded scene description reflecting the intention of an 
author who produces contents and makes a relationship table between each of the elementary streams and its priority 
as shown in Table 1 . The error-correction coding section 31 , based on the priority information of the stream; selects 
an error-correction method; and performs error-correction coding of each stream with the selected error-correction 

55 method. The error-correction coding section 31 also has a function to perform error-correction coding of the scene 
description, similarly to each stream. The scene description is regarded as the most important data. 
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Table 1 



Stream 


Priority 


ESJD1 


16 


ESJD2 


8 


ESJD3 


4 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



[0034] The packet multiplexing section 32 receives each coded stream and scene description after error-correction 
coding by the error-correction coding section 31 , multiplexes them, and makes them into packet data for transmission 
on the data transmission channel 8. The data transmission section 33 adds necessary header based on individual 
transmission protocol to the packet with the above configuration, and outputs the packet data to the data transmission 
channel 8. 

[0035] A data demultiplexing section 40 demultiplexes the multiplexed data received through the data transmission 
channel 8 into the coded elementary stream and coded scene description. The data demultiplexing section 40 com- 
prises a data reception section 43, a packet demultiplexing section 42, and an error-correction decoding section 41 . 
The data reception section 43 receives the packet data transmitted on the data transmission channel 8, and the packet 
demultiplexing section 42 demultiplexes the packet data received by the data reception section 43 into the coded 
elementary stream and coded scene description based on the multiplexing header part. 
. [0036] The error-correction decoding section 41 obtains the priority of each coded elementary stream from coded 
scene description, and performs error-correction decoding based on the error-correction method according to the pri- 
ority. When the error-correction method used for the error-correction coding is, for example, a plural-time transmission 
method, a repeated time for each code is determined according to the priority. The section 41 has a function for repro- 
ducing the elementary streams and coded scene description by removing bits from each stream and the coded scene 
description by the repeated times. 

[0037] The object decoding sections 5 decode the elementary streams to reproduce the object data. The scene 
description decoding section 6 decodes the coded scene description. The scene synthesizing section 7 synthesizes 
the object data from the object decoding sections 5 for reproduction, based on the scene description from the scene 
description decoding section 6. 

[0038] In the device having such configuration, each object such as moving pictures and audio is compressed and 
coded by the object coding section 1 . Each coded object data is made into one stream which is called as an elementary 
stream (ES). 

[0039] The scene description, which is information for reproduction of one scene by synthesizing the objects, is 
coded by the scene description coding section 2. 

[0040] The data multiplexing section 30 performs error-correction coding of the elementary streams ES and scene 
description, multiplexes them, and sends the multiplexed data to the data transmission channel 8. 
[0041 ] The feature of the present embodiment is to protect data with relatively greater importance at data transmission 
on . a transmission channel with possible errors by performing error-correction according to the priority, referring to 
stream priority information included in the MPEG-4 objects as information on the priority of objects not only in the 
M.PEG-4 system, but also in the data multiplexing section 30. 

[0042] In the MPEG-4, the priority information of each stream is included in the scene description for use in repro- 
duction of images. Then, in this embodiment, an appropriate error-correction method of each object has been selected 
according to the priority information. In order to realize select the method, the error-correction coding section 31 ana- 
lyzes the priority information based on the scene description, and selects an appropriate error-correction method of 
each object. 

[0043] However, the information on the scene description is made into data in binary form in the case of MPEG-4, 
and then, there are some difficulties for the data multiplexing section 30 to analyze the priority. For such cases, it is 
possible to provide another interface different from the scene description coding section 2, and the priority information 
may be input through the above interface to the data multiplexing section 30. 

[0044] The error-correction coding section 31 makes a relationship table (Table 1) between each stream and its 
priority, using information on the scene description. 

[0045] In the case of an example shown in Table 1 , the stream of "ES JD1 " has priority "1 6" , one of "ESJD2*' priority 
M 8" , one of "ESJD3" priority "4" , and the like. 

[0046] Then, the error-correction coding section 31 selects an error-correction method based on the priority of the 
stream. In general, the error-correction methods by FEC (forward error-correction) are roughly classified into two meth- 
ods shown in the following. 
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[1 ] A method in which the same data are repeatedly transmitted a plurality of times (plural-time transmission meth- 
od). 

[2] A method in which codes are used so as to correct errors (error-correction coding). 

s [0047] Hereinafter, an example adopting the former type, the plural-time transmission method will be described. 
[0048] In plural-time transmission method, one bit-field is simply repeated a plurality of times according to the level 
of error-correction. The receiving side estimates the bit, for example, by a majority method. For example, in the case 
of an error-correction coding where the number of repetition is three, if contents of the data of a certain one bit-field 
includes one "0", and two 'T's, the bit is judged to be "1". It may be possible to theoretically perform 100% error- 

10 correction for random errors with 33 [%] by the three-time transmission method at the receiving side. Hereinafter, the 
plural-time transmission method is assumed to be adopted in the present embodiment, for simplicity. 
[0049] As a method to determine an appropriate level (the number of repetition) of the error-correction method used 
for the plural-time transmission method, it is assumed to be selected by a value obtained by multiplication of a certain 
constant k by the priority of objects. That is, the number of repetition for the priority of objects is selected by the following 

is equation: 

Number of repetition = priority of streams x k (1) 

20 where, a word of the priority of streams is used, in stead of a word of the priority of objects, in the equation (1), 

but they actually denote the same, though the word of the priority streams is used, considering that the priority is given 
to a data stream as the error-correction coding is performed for data streams to be transmitted, and the target is a data 
stream. 

[0050] Now, if Table 1 shows the relationship between streams and priorities, numbers of repetition selected based 
25 on the equation (1 ) are shown in Table 2. Where k = 0.3. 



Table 2 



Stream 


Priority 


Repetition number 


ESJD1 


16 


4 


ESJD2 


8 


2 


ESJD3 


4 


1 



[0051] The case of an example shown in Table 2 shows that a stream of n ES_ID1 M has a priority of 16, and the 
number of repetition is 4; a stream of "ESJD2" has a priority of 8, and the number of repetition is 2; and a stream of 
"ESJD3" has a priority of 4, and the number of repetition is 1 ; and the like. 

[0052] Thus, the error-correction coding section 31 performs error-correction coding of data of each stream selected 
by the error-correction method based on the priority. 

[0053] Fig. 3 shows a configuration example of packets where the plural-time transmission method is used for error- 
correction, and the number of repetition is 3. That is, when original data is formed of bO, b1 , b2 and the number of 

repetition is 3 in the plural-time transmission method, the packet configuration is: bO, bO, bO, b1.b1.b1, b2, b2, b2, 
where the same bit is repeated by three. 

[0054] The error-correction coding section 31 also performs error-correction coding of the scene description similarly 
to the streams. As the scene description is the most important data, error-correction coding is performed for the data 
with the greatest importance. For example, it is assumed that the scene description has the priority twice the highest 
one in the priority among streams. Therefore, the number of repetition becomes six times in the example of FIG. 3. 
[0055] The data after error-correction coding by the error-correction coding section 31 are delivered to the packet 
multiplexing section 32. The packet multiplexing section 32 multiplexes the data of each stream and the scene de- 
scription after error-correction, and makes them into one packet for transmission on the data transmission channel 8. 
[0056] Fig. 4 shows a packet configuration example in the packet multiplexing section 32. The configuration of the 
packet is as shown in FIG. 4: multiplexing header, scene description, ES_1 header, ES_1 payload, ES_2 header, ES_2 
payload, and where ES_1 , ES_2, ... denote No. 1 , No. 2, ... of the elementary stream ES. 

[0057] The' transmission section 33 adds a necessary header based on a transmission protocol to the packet com- 
prised in the above manner; and outputs the packet to the data transmission channel 8. 

[0058] Now, processing in the receiving system will be described. In the receiving system, the data transmitted 
through the data transmission channel 8 is received by the data demultiplexing section 40. Specifically, the data re- 
ception section 43 receives the packet data from the transmission side transmitted as packet in a form shown in FIG. 
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4, and supplies it to the packet demultiplexing section 42. 

[0059] The packet demultiplexing section 42 demultiplexes the received packet into the streams and scene descrip- 
tion, referring to the multiplexing header, and supplies them to the error-correction decoding section 41 . 
[0060] The error-correction decoding section 41 obtains the priority of each stream from the scene description, and 
5 selects the number of repetition, based on the above equation (1). The scene description is made into a binary form 
in the case of the MPEG-4, and it is difficult to analyze it at the data demultiplexing section 40. Therefore, once the 
scene description information is supplied to the scene description decoding section 6, the analyzed object priority 
information is supplied to the data demultiplexing section 40 through another interface. 

[0061] The error-correction decoding section 41 performs error-correction decoding of the code, based on the infor- 
10 mation on the number of repetition obtained through the above selection. An error-correction decoding method used 
for the above case is the above selection method by majority. 

[0062] As shown above, as there is less degradation in data quality due to data errors for objects with higher impor- 
tance by transmitting data after performing error-correction coding with changing the error-correction ability, according 
to the priority of each object given beforehand when performing error-correction coding for transmission of each object 

15 of MPEG-4, data transmission with high quality may be realized in the present embodiment. As the error-correction 
coding is performed, changing the level of the error-correction according to the priority of each object, the amount of 
data is increased for the important one, and it is decreased for less important one. Therefore, data transmission with 
high quality may be realized without excessively increased amount of data, and with real-time transmission. 
[0063] In the above embodiment, the error-correction coding method is adaptively changed in each object, based 

20 on the importance of objects composing a content, and it is possible to obtain data reproduction quality similar to the 
intention of a content author at the data receiving side in data transmission through a data transmission channel with 
unavoidable data errors, though the quality of the transmission channel is not considered. 

[0064] But, an ideal fine control may become possible by consideration of the quality of the channel. For example, 
the level for error-correction may be lowered on a transmission channel with less possibility of error generation, and It 
25 may be required to further raise the error-correction level for keeping the data reproduction quality on the channel with 
increased possibility of the generation. 

[0065] Then, a second embodiment with consideration of the quality of the transmission channel will be described 
hereinafter. 

30 Second embodiment 

[0066] In the present embodiment, a detector for detecting traffic on the data transmission channel 8 is newly installed, 
and there is shown an example where the error-correction coding method is selected based on the output of the detector 
as well as the priority. In this embodiment, traffic situation on the data transmission channel 8 is detected, using the 
35 detector to detect traffic on the data transmission channel 8, in addition to the configuration of the first embodiment. 
Thereby, the data receiving side may obtain further higher data reproduction quality, and it is possible to prevent the 
degradation in reproduction of objects from received data with data errors caused on the transmission channel 8, 
without causing excessively increased amount of data, and while maintaining real-time transmission, in data transmis- 
sion of objects. 

40 [0067] FIG. 5 shows an example of a principal portion of a system in the present embodiment. A basic configuration 
is the same as that of the first embodiment shown in FIG. 2, comprising the object coding sections 1 (not shown) coding 
the object data; scene description coding section 2 (not shown) for coding the scene description; data multiplexing 
section 30 multiplexing data from the object coding sections 1 and the scene description coding section 2, and trans- 
mitting the multiplexed data to the data transmission channel 8; data demultiplexing section 40 (not shown) demulti- 

45 plexing the multiplexed data transmitted through the data transmission channel 8; object decoding sections 5 (not 
shown) decoding the streams; scene description decoding section 6 (not shown) decoding the coded scene description; 
and scene synthesizing section 7 (not shown) synthesizing scenes, based on the object data from the object decoding 
sections 5, and the scene description from the scene description decoding section 6 to reproduce images. 
[0066] The data multiplexing section 30 according to the second embodiment also comprises the error-correction 

so coding section 31 , packet multiplexing section 32, and data transmission section 33. Moreover, a transmission traffic 
detector 50 to detect a traffic state on the data transmission channel 8 is newly installed, other than the above sections, 
in the present embodiment. 

[0069] The transmission traffic detector 50 detects the quality (data error incidence, data transmission rate, and the 
like) of the data transmission channel 8 during communication. The error-correction coding section 31 receives the 
55 scene description reflecting the intention of a content author; makes a relationship table between each stream and the 
priority, for example, as shown in Table 1 ; then, selects an error-correction coding method, based on the priority of the 
stream; and performs error-correction coding of each stream with the selected error-correction coding method. The 
error-correction coding section 31 has a function to perform error-correction coding of data of the scene description, 
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similarly to the case of each stream. As the scene description is the most important data, the description is configured 
to be coded for error-correction as data with the greatest importance. 

[0070] Moreover, the error-correction coding section 31 has a function to perform error-correction coding of each 
stream according to the quality of the data transmission channel 8 detected by the transmission traffic detector 50. 

5 The error-correction coding section 31 is configured so that the error-correction coding method selected based on the 
priority given to each stream may be added, and the error-correction ability may be changed according to the quality 
of the transmission channel 8 in the error-correction coding method of the first embodiment, by applying an error- 
correction coding method selected according to the quality of the data transmission channel 8. 
[0071 ] The packet multiplexing section 32 receives data of each stream and scene description after error-correction 

10 by the error-correction coding section 31 , multiplexes them into packet data (one stream for data transmission). The 
data transmission section 33 adds a necessary header based on a transmission protocol to the packet configured as 
above, and outputs the packet data to the data transmission channel 8. 

[0072] In the present embodiment, the basic configuration is similar to that of the first embodiment, except processing 
in the error-correction coding section 31 and the transmission traffic detector 50. 
15 [0073] The feature of the present embodiment is in processing in the error-correction coding section 31 and the 
transmission traffic detector 50. The processing in the two blocks will be mainly described hereinafter. 
[0074] The transmission traffic detector 50 detects the quality of the traffic on the data transmission channel 8 during 
communication. The quality denotes: 

20 data error incidence; 

data transmission rate; and the like. 

In the present embodiment, the data error incidence is detected. The information on the quality of the traffic detected 
in the transmission traffic detector 50 Is appropriately transmitted to the error-correction coding section 31 . 
25 [0075] The error-correction coding section 31 performs error-correction coding of each stream based on the data 
error incidence information detected by the transmission traffic detector 50 and the stream priority which is described 
in the scene description. 

[0076] It is assumed that the plural-time transmission method is used as a method of the error-correction coding. 
The number of repetition to determine the error concealment is defined by the following expression. If it is assumed 
30 that, for example, e 1 is as a mean error incidence, e 2 as the present error incidence, and a certain constant k, the 
number of repetition may be selected by the following equation: 



[0077] Thus, in addition to the first embodiment, it is possible to perform more efficient data transmission suitable 
for the state of the data transmission channel 8 by changing the error-correction level according to the quality of the 

40 data transmission channel 8. 

[0078] As mentioned above, the present embodiment is a transmission system to multiplex and transmit a plurality 
of objects through the transmission channel 8. In the data transmission apparatus in which priority of each object is 
previously given, and real-time transmission is required, the communication traffic detector 50 which detects the quality 
of the traffic of the transmission channel 8 is installed; and the error-correction coding section 31 is installed. The data 

45 multiplexing section 30 has a function to determine an error-correction coding method for each object, based on the 
quality information on the traffic obtained by the communication traffic detector 50, and the priority given to each object. 
[0079] The communication traffic detector 50 detects the quality of the traffic of the transmission channel 8, for ex- 
ample, data error incidence, data transmission rate, and the like. In the error-correction coding section 31 , the error- 
correction coding method with required error-correction ability is selected, based on the quality information on the 

so traffic, and the priority given to each object. Error-correction coding of each object is performed with the selected error- 
correction coding method. Data after the error-correction coding are multiplexed by the multiplexing section 32, and 
delivered to the transmission channel 8 through the data transmission section 33. There have been known several 
error-correction coding methods. For example, if plural-time transmission method is used, as a determining factor for 
the error-correction ability is the number of repetition, the above number of repetition is defined as follows. 

55 [0080] For example, the number is 1 + (stream priority) x (e 2/e 1 ) x k, if it is assumed that the mean error incidence 
is set as e 1 , the present error incidence as e 2 and a certain constant as k. 

[0081] Thus, more efficient data transmission suitable for the situation of the transmission channel 8, and data trans- 
mission to prevent degradation in reproduced content, while maintaining real-time transmission, is realized by perform- 



Number of repetition: 
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ing error-correction coding by changing the error-correction level according to the quality of the transmission channel 
in addition to the priority of the stream. 

[0082] Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the present 
invention in its broader aspects is not limited to the specific details, representative devices, and illustrated examples 

5 shown and described herein. Accordingly, various modifications may be made without departing from the spirit or scope 
of the general inventive concept as defined by the appended claims and their equivalents. For example, in the above 
embodiments, the error-correction level is changed according to the object priority (the importance of the object), but 
it is possible that transmission of objects with lower priority, for example, a background part, is stopped at the data 
multiplexing and transmission section without changing the error-correction coding method. For example, it is possible 

10 to stop one of error-correction coding, multiplexing, and transmission at the transmission side and to stop error-cor- 
rection decoding at the reception side based on the priority. Further, it may be conceivable that transmission of objects 
with lower priority than a certain level is stopped, when the communication quality of the transmission channel is tem- 
porarily degraded by feedback from the traffic detector, and the data transmission rate is lowered. 
[0083] The present invention may realize an apparatus with further more efficient data transmission by installing a 

1 $ monitor of the traffic state on the data transmission channel and considering the traffic information from the monitor. 
For example, if there are a plurality of transmission channels, it is possible to assign a transmission channel with less 
error incidence for objects with greater importance, or stop data transmission in a unit of an object, in addition to 
changing the error-correction coding method. Thereby, it is possible to realize a system to transmit important object 
data in real-time, depending on the situations. 

20 [0084] As mentioned above in detail, according to the present invention, in data transmission through a data trans- 
• mission channel with unavoidable data error incidence, the data receiving side may obtain data reproduction quality 
approximately according to the intention of a content author by adaptively changing the error-correction coding method 
every object based on the importance of object, or the data receiving side may obtain further better data reproduction 
quality by detecting the traffic state on the data transmission channel, and by adaptively changing the error-correction 

25 coding method according to the detection result. It is possible to provide a data transmission apparatus to prevent the 
degradation in object reproduction from received data with data errors caused during transmission on the transmission 
channel while maintaining the real-time transmission without excessive increased amount of data in data transmission 
of objects. 



30 



35 



Claims 

1 . A data transmission apparatus for transmitting data comprising a plurality of objects having respective priority, the 
apparatus characterized by comprising: 



means (31) for selecting an error-correction coding method for each of the plurality of objects based on the 
priority of each of the plurality of objects; 

means (31) for error-correction coding of each of the plurality of objects using the selected error-correction 
coding method; and 

40 means (32, 33) for multiplexing plurality of coded object data and transmitting multiplexed data through a 

transmission channel. 

2. The data transmission apparatus according to claim 1 , characterized in that the error-correction coding method is 
based on a plural-time transmission method and said selecting means determines the number of times of trans- 

45 mission in the plural-time transmission method based on the priority. 

3. The data transmission apparatus according to claim 1 , characterized by further comprising means (33) for stopping 
at least one of error-correction coding, multiplexing the coded object data, and transmission of the multiplexed 
data based on the priority. 

50 

4. The data transmission apparatus according to claim 1 , characterized by further comprising means (50) for detecting 
a traffic quality of the transmission channel, and characterized in that said selecting means selects an error-cor- 
rection coding method based on the priority of each object and the traffic quality. 

55 5. The data transmission apparatus according to claim 4, characterized in that the error-correction coding method is 
based on a plural-time transmission method and said selecting means determines the number of times of trans- 
mission in the plural-time transmission method based on the priority and the traffic quality. 
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6. The data transmission apparatus according to claim 4, characterized by further comprising means (33) for stopping 
at least one of error-correction coding, multiplexing the coded object data, and transmission of the multiplexed 
data based on the priority and the traffic quality. 



5 7. A data reception apparatus for receiving coded transmission data comprising a plurality of coded object data, each 
object having a priority, the apparatus characterized by comprising: 

means (43, 42) for receiving and demultiplexing the coded transmission data into the plurality of coded object 
data; 

io means (41 ) for detecting the priority of each object; and 

means (41 ) for error-correction decoding of each of the coded object data based on the priority detected by 
said detecting means. 

8. The data reception apparatus according to claim 7, characterized in that the coded transmission data is based on 
15 a plural-time transmission coding method and said error-correction decoding means determines a value of the 

coded object data using a majority method based on the priority. 



9. The data reception apparatus according to claim 7, characterized by further comprising means (41) for stopping 
an operation of said error-correction decoding means based on the priority. 

10. The data reception apparatus according to claim 7, characterized by further comprising means (50) for detecting 
a traffic quality of a transmission channel for transmitting the coded object data, and characterized in that said 
error-correction decoding means error-correction decodes the coded object data based on the priority and the 
traffic quality detected by said detecting means. 

11. The data reception apparatus according to claim 10, characterized in that the coded transmission data is based 
on a plural-time transmission coding method and said error-correction decoding means determines a value of the 
coded object data using a majority method based on the priority and the traffic quality. 



30 1 2. The data reception apparatus according to claim 1 0, characterized by further comprising means (41 ) for stopping 
an operation of said error-correction decoding means based on the priority and the traffic quality. 



13. An object coding apparatus for transmitting data formed of a plurality of object data and scene description data, 
each object having a priority, the scene description data indicating the priority of each object and how the object 

35 data are synthesized, the apparatus characterized by comprising: 

means (31 ) for determining error-correction coding methods for the plurality of object data respectively based 
on the priority; 

means (31) for error-correction coding of each of the plurality of object data using the determined error-cor- 
40 rection coding methods; 

means (31) for error-correction coding of the scene description data using a predetermined error-correction 
coding method; and 

means (32, 33) for multiplexing coded scene description data and a plurality of coded object data and trans- 
mitting multiplexed data. 

45 

14. An object coding/decoding system characterized by comprising: 



the object coding apparatus according to claim 1 3; and 
an object decoding apparatus comprising: 

means (43, 42) for receiving and demultiplexing the multiplexed data from said object coding apparatus into 

the coded scene description data and the plurality of coded object data; 

means (41) for detecting the priority of each object from the coded scene description data; 

means (41 ) for error-correction decoding of each of the plurality of coded object data using a decoding method 

based on the priority detected by said detecting means; 

means (41 ) for error-correction decoding of the coded scene description data using a predetermined decoding 
method; and 

means (7) for synthesizing plurality of decoded object data based on a decoded scene description. 
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15. A data transmission method for transmitting data comprising a plurality of objects having respective priority, the 
method characterized by comprising the following steps of: 

selecting an error-correction coding method for each of the plurality of objects based on the priority of each 
5 of the plurality of objects; 

error-correction coding of each of the plurality of objects using the selected error-correction coding method; and 
multiplexing plurality of coded object data and transmitting multiplexed data through a transmission channel. 

16. The data transmission method according to claim 15, characterized in that the error-correction coding method is 
w based on a plural-time transmission method and said selecting step determines the number of times of transmission 

in the plural-time transmission method based on the priority. 

17. The data transmission method according to claim 15, characterized by further comprising a step of stopping at 
least one of error-correction coding, multiplexing the coded object data, and transmission of the multiplexed data 

*s based on the priority. 

18. The data transmission method according to claim 15, characterized by further comprising a step of detecting a 
traffic quality of the transmission channel, and characterized in that said selecting step selects an error-correction 
coding method based on the priority of each object and the traffic quality. 

20 

19. The data transmission method according to claim 1 8, characterized in that the error-correction coding method is 
based on a plural-time transmission method and said selecting step determines the number of times of transmission 
in the plural-time transmission method based on the priority and the traffic quality. 

25 20. The data transmission method according to claim 18, characterized by further comprising a step of stopping at 
least one of error-correction coding, multiplexing the coded object data, and transmission of the multiplexed data 
based on the priority and the traffic quality. 

21 . A data reception method for receiving coded transmission data comprising a plurality of coded object data, each 
30 object having a priority, the method characterized by comprising the following steps of: 

receiving and demultiplexing the coded transmission data into the plurality of coded object data; 
detecting the priority of each object; and 

error-correction decoding of each of the coded object data based on the priority detected by said detecting step. 

35 

22. The data reception method according to claim 21 , characterized in that the coded transmission data is based on 
a plural-time transmission coding method and said error-correction decoding step determines a value of the coded 
object data using a majority method based on the priority. 

40 23. The data reception method according to claim 21 , characterized by further comprising a step of stopping an op- 
eration of said error-correction decoding step based on the priority. 

24. The data reception method according to claim 21 , characterized by further comprising a step of detecting a traffic 
quality of a transmission channel for transmitting the coded object data, and characterized in that said error-cor- 

45 rection decoding step error-correction decodes the coded object data based on the priority and the traffic quality 

detected by said detecting step. 

25. The data reception method according to claim 24, characterized in that the coded transmission data is based on 
a plural-time transmission coding method and said error-correction decoding step determines a value of the coded 

50 object data using a majority method based on the priority and the traffic quality. 

26. The data reception method according to claim 24, characterized by further comprising a step of stopping an op- 
eration of said error-correction decoding step based on the priority and the traffic quality. 

55 27. An object coding method for transmitting data formed of a plurality of object data and scene description data, each 
object having a priority, the scene description data indicating the priority of each object and how the object data 
are synthesized, the method characterized by comprising the following steps of: 
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determining error-correction coding methods for the plurality of object data respectively based on the priority; 
error-correction coding of each of the plurality of object data using the determined error-correction coding 
methods; 

error-correction coding of the scene description data using a predetermined error-correction coding method; 
5 and 

multiplexing coded scene description data and a plurality of coded object data and transmitting multiplexed 
data. 

28. An object coding/decoding method characterized by comprising the following steps of: 

10 

determining error-correction coding methods for the plurality of object data respectively based on the priority; 
error-correction coding of each of the plurality of object data using the determined error-correction coding 
methods; 

error-correction coding of the scene description data using a predetermined error-correction coding method; 
is multiplexing coded scene description data and a plurality of coded object data and transmitting multiplexed 

data; 

receiving and demultiplexing the multiplexed data from said object coding apparatus into the coded scene 
description data and the plurality of coded object data; 
detecting the priority of each object from the coded scene description data; 
20 error-correction decoding of each of the plurality of coded object data using a decoding method based on the 

priority detected by said detecting step; 

error-correction decoding of the coded scene description data using a predetermined decoding method; and 
synthesizing plurality of decoded object data based on a decoded scene description. 

25 
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